When One Size Does Not Fit All: A Simple Statistical Method to Deal with Across-Individual Variations of Effects
نویسندگان
چکیده
In science, it is a common experience to discover that although the investigated effect is very clear in some individuals, statistical tests are not significant because the effect is null or even opposite in other individuals. Indeed, t-tests, Anovas and linear regressions compare the average effect with respect to its inter-individual variability, so that they can fail to evidence a factor that has a high effect in many individuals (with respect to the intra-individual variability). In such paradoxical situations, statistical tools are at odds with the researcher's aim to uncover any factor that affects individual behavior, and not only those with stereotypical effects. In order to go beyond the reductive and sometimes illusory description of the average behavior, we propose a simple statistical method: applying a Kolmogorov-Smirnov test to assess whether the distribution of p-values provided by individual tests is significantly biased towards zero. Using Monte-Carlo studies, we assess the power of this two-step procedure with respect to RM Anova and multilevel mixed-effect analyses, and probe its robustness when individual data violate the assumption of normality and homoscedasticity. We find that the method is powerful and robust even with small sample sizes for which multilevel methods reach their limits. In contrast to existing methods for combining p-values, the Kolmogorov-Smirnov test has unique resistance to outlier individuals: it cannot yield significance based on a high effect in one or two exceptional individuals, which allows drawing valid population inferences. The simplicity and ease of use of our method facilitates the identification of factors that would otherwise be overlooked because they affect individual behavior in significant but variable ways, and its power and reliability with small sample sizes (<30-50 individuals) suggest it as a tool of choice in exploratory studies.
منابع مشابه
Does One Size Fit All? The Impact of Liquidity Requirements on Bank\'s Insolvency: Evidence from Iranian Listed Banks
According to the Basel III regulatory framework, uniform minimum liquidity requirements have been imposed on all types of banks. Using an agent-based model of a banking system, we investigate the effects of liquidity requirements on banks' insolvency under two policy experiments in one of which the minimum liquidity requirements are applied uniformly and in the other differentially across banks...
متن کاملI-43: Scientific and Religious Controversies on The Beginning of Human Life- What Does 3D/4D Sonography Offer?
One of the most controversial topics in modern bioethics, science, and philosophy is the beginning of individual human life. In the seemingly endless debate, strongly stimulated by recent technologic advances in human reproduction, a synthesis between scientific data and hypothesis, philosophical thought, and issues of humanities has become a necessity to deal with ethical, juridical, and socia...
متن کاملProvide treatment strategies based on psycho-individual mechanisms affecting psychological competence and individual creativity
Background and Aim: One of the most important challenges of today's managers in organizations is the insufficient use of intellectual resources, mental capacity and potential capacities of human resources; In most organizations, the capabilities of employees are not used optimally and managers are not able to use their potential. Certainly, an organization is more successful if it has a capable...
متن کاملEmployee Engagement and Individual Differences: A Study in Indian Context
The employee engagement has emerged as a pivotal business driver for organizational success. High level of engagement in domestic and global firms is supposed to have multiple enriching effects on an organization. Studies have highlighted the importance of both organizational and individual factors in ensuring highly engaged employees. The present paper explores the individual differs across fo...
متن کاملExperimental Studies on the Effects of Process Parameters on Granule Properties in a Conical High Shear Granulator
Experimental work was carried out to investigate the influence of impeller speed, granulation time, binder mass and their interactions on granule size distribution, mean size and binder content distribution in a conical high shear granulator. It was observed that the response of high shear granulation to changes in process parameters varies significantly from one operating condition to anot...
متن کامل